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ABSTRACT 


Unclassified historical data concerning the United States in- 
volvement in military conflicts is used to model the behavioral patterns 
of the past as a Markov Process. The stochastic properties of the 
model are calculated and their usefulness as tools in the. study of 


cost-effectiveness is discussed. 
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I. A COST EFFECTIVENESS MODEL 


Within the last few years the term, "cost-effectiveness" has 
lost its formality while extending and diversifying its aoplicability so 
that it now includes all phases of system and component design, 
development, production and operation. The basic concept of cost- 
effectiveness analysis as an analytical technique for evaluating alter- 
native choices having economic and management implication has 
produced evaluation processes which are extremely sophisticated and 
complex, but which fail at times to provide the correct solution. The 
ability to make the correct decision involving an appropriate cost for 
a system under study remains difficult in itself and can be made 
virtually impossible if the decision-maker is led astray by analysis 
which is biased by the exclusion and/or inclusion of inappropriate 
cost categories. To determine the relative merits of various weapon 
systems it is imperative that the wartime cost categories be specifically 
identified and standardized. Another critical area, the mathematical 
relationship between cost and effectiveness, is still open to debate. 
This paper discusses these problems with regard to a military weapon 
system and develops a stochastic model which may assist in the 
search for correct answers. 

A simple categorization of the major cost categories for a military 
weapon system which can be used as a focal point for developing other 


cost guidelines is: 





Research & Development Costs 
Peacetime Investment Cost 
Peacetime Operating Costs 
Wartime Investment Cost 
and Wartime Operating Cost 
In response to : Similar list of cost categories TRW Systems 
Group has suggested, [Ref. 1], that system costs could be more ex- 
plicitly related to system effectiveness if both were evaluated at the 
same level of military activity. For example, system wartime effec- 
tiveness is evaluated under a variety of missions and scenarios, 
therefore, wartime Operating costs should be similarly measured at 
various levels of war in order to increase the preciseness of the results. 
Additionally, since it is common for the life-cycle of a weapon system 
to span periods of peacetime and various levels of military activity, 
estimates of system life-cycle cost should include the utilization of 
weighting factors applied to the various operating costs in proportion 
to the probability of the United States being in a state of peace or 
appropriate level of military involvement during a given time period. 
And finally, a weighting factor related to the expected frequency of 
war should also be used to correctly apportion the contribution of 
wartime investment costs to the total life-cycle costs. 
As a first approximation, the military conflicts can be separated 
into the two categories of WAR and HALF-WAR relative to their intensity, 


number of casualties, etc. The stochastic properties mentioned above 
8 





can then be applied to the major cost categories to obtain a "top level” 
probabilistic, life-cycle cost equation for use as a guideline in final 
cost estimation and as a new analytical tool for gaining more insight 
into the resource requirements to be expected during a system's life- 
time. This was done by TRW Systems Group [Ref. 1] and the resulting 
life-cycle cost equation was: 


Life-Cycle Cost = (R&D cost) + (Peacetime Investment cost) 


(t) 


* Dyw-HWw 


(Investment Cost/transition) 


NW-HW 
7 1 (t) (Investment Cost/transition) 
NW -W NW-W 
== 19) (t) (Investment Cost/transition) 
HW -W HW-W 
T 
+) 
Sy sire (Annual Ops costs) aap) 
k=] k k 
T 
+ e (P ) (Annual Ops costs ) 
= HALF -WAR,. HALF -WAR, 
dk 
+ ». (P ) (Annual Ops costs 2 oe 
sel ae ; WAR, 


where the P's are the weighting factors based on the probability that 
the U. S. will be in a state of WAR, HALF-WAR, or NO-WAR in any 
year, k, and the n's are the number of transitions into the various 
states of war with both p andn being calculated over the system's 
total operating life span of T years. The investment cost per transition 


is a finite cost for war escalations and zero otherwise. 





Using this approach the major categories of wartime costs can 
be tied explicitly to system wartime effectiveness analyses. 
A mathematical model was developed by TRW Systems Group 


[Ref. 1] for quantitative determination of the probabilities and frequen- 


cies of war under the following conditions: 
(a) |The model operates in discrete time 


(b) The unit of time is one year 
(c) Historical data from 1900 - 1967 is considered 


The purpose of this paper is to develop a mathematical model to 


quantitatively determine similar probabilities and frequencies, but 


One which operates as follows: 


(a) The model operates in continuous time 


(b) The unit of time is one month 


(c) Historical data from 1775 - 1970 is considered. 
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II. HISTORICAL DATA 


The military activities of the United States considered significant 
in the context of this paper are those listed in The Encyclopedia of 
Military History [Ref. 2]. References 3, 4, and 5 were useful in 
determining a precise commencement and/or termination date in the 
case Of several of the conflicts being examined. 

For the purpose of categorizing the various levels of military 
involvement, the state of WAR is defined as a shooting war with troop 
and equipment losses which has a distinct effect on the economy of the 
United States. The state of HALF-WAR is defined as a state of military 
involvement where troops and equipment are deployed, but either losses 
are relatively light or the economy of the United States as a whole is 
relatively unaffected. The state of NO-WAR is the state of relative 
peace which exists when neither a state of WAR nor a state of HALF-WAR 
exists. 

The following interpretations were used to classify the historical 
data: 

l. The start of a WAR during a period of HALF-WAR causes a 

| change of state from HALF-WAR to WAR. 

De The start of a HALF-WAR during a period of WAR causes 

no change of state. 
cae The start of a second, distinctly different, HALF-WAR 


during a period of existing HALF-WAR causes no change of 


1] 





state, but simply permits the existing state of HALF-WAR 
to continue until the conclusion of the longer HALF-WAR, 
or a transition into a state of WAR occurs. This interpre- 
tation is taken because the calculations of cost-effectiveness 
in this paper depend only on the intensity of military 
activity and not on their theater of operation. Similar con- 
ventions apply to the states of NO-WAR and WAR, hence 
transitions between the same two states are not possible. 
4. A change of state from HALF-WAR to WAR cannot occur as 
the result of a combination of concurrent HALF-WARS. 
oe The month during which a change of state occurs is evaluated 
as a month during which the new state existed. 
It is not the author's claim that this interpretation of data provides 
a precise categorization of the conflicts nor that the list of military 
activities considered is neither lacking nor in excess, but only that it 
provides a reasonable data base, consistent with the intent of the 
problem, to which an attempt can be made to fit a stochastic model. 
The remaining pages of this chapter contain a complete list of 
the military conflicts considered, along with their classification as 
states of WAR (W) or HALF-WAR (HW) in accordance with the proposed 
scheme and a graphical representation of the resulting sequence of 


state transitions (Figure I). 
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AMERICAN MILITARY ACTION 1775 - 1970 


DATES 
fee 1775 —- Apr 1783 
Nov 1798 - Sep 1800 
Jul 1801 - Aug 1805 


Moy 1811 -jJun 1812 


Jun 1812 - Dec 1814 


Mar 1815 - Jun 1815 


Nov 1817 - May 1818 
Apr 1832 - Aug 1832 
Dec 1835 - Dec 1843 
Jun 1835 - Apr 1836 
Mar 1846 - Feb 1848 
Jan 1850 - Oct 1879 
Apr 1861 - May 1865 
May 1885 - Sep 1886 
Dec 1890 - Jan 1891 
Apr 1898 - Dec 1898 
Pew 1899 - Jul 1902 
min 1900 - Oct 1900 
ful 1902 - jul 1905 


Nov 1903 -.Nov 1903 


ACTION 
War of the American Revolution 
Quasi War with France 
Tripolitan War 


Indian War against Shawnees 
and Friction with Britain 


War of 1812 


American War with Algiers 
(Barbary Wars) 


First Seminole War 

Black Hawk War 

Second Seminole War 

War of Texas Independence 
U.S. - Mexican War 
American Indian Wars 

Civil War 

Apache War 

Sioux War in South Dakota 
Spanish - American War 
Guerrilla War in the Philippines 
Boxer Rebellion in China 
Moro Campaign 


Panamanian Revolt 
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STATE CLASSI- 
PICATION __ 


W 
HW 


HW 


HW 


HW 


HW 





DATES 
Oct 1906 - Dec 1909 


Jan 1912 -Jan 1913 


Apr 1914 - Nov 1914 
Jul 1915 - Sep 1915 


Mar 1916 - Feb 1917 
Nov 1916 - Jul 1924 


Apr 1917 - Nov 1918. 


Aug 1918 - Apr 1920 


Wan 1927 - Nov 1928 


Jan 1931 - Jan 1933 


Dec 1941 - Aug 1945 
Jun 1948 - Sep 1949 
Jun 1950 - Jul 1953 
jul 1958 - Oct 1958 


Nov 1960 - Dec 1960 
Dec 1961 - 


Oct 1962 - Nov 1962 
Aug 1964 - 


Apr 1965 - May 1965 


ACTION 
Army of Cuban Pacification 


Intervention in Honduras and 
Nicaragua 


Tampico and Vera Cruz Incidents 
Intervention in Haiti 


Mexican Border Operations 
against Pancho Villa 


Intervention in the Dominican 


Republic 


World War I 


Expeditions into Northern Russia 
and Siberia 


Intervention in Nicaragua 


Intervention in Nicaragua 
(The Sandino Affair) 


World War II 

Berlin Blockade 

Korean War 

U.S. Troops to Lebanon 


U.S. Warships Protect 
Guatemala and Nicaragua 


U.S. Support Units Arrive in 
South Vietnam 


Cuban Missile Crisis 
Tonkin Gulf Resolution 
Intervention in Dominican 


Republic 
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STATE CLASSI- 


FICATION 


HW 


HW 


HW 


HW 


HW 


HW 


HW 


HW 


HW 


HW 
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ITI. MARKOV PROCESSES 


This paper uses continuous time, finite state MARKOV Processes. 
The definitions and special properties of these and other terms which 
will be used later in the construction of the mathematical model are 


developed at this time to provide continuity in the later sections. 


A. FUNDAMENTAL DEFINITIONS 

A MARKOV PROCESS (MP) is a special type of stochastic process 
distinguished by the property that the distribution of its future behavior, 
when its present state is known, is not altered by additional knowledge 
concerning its past behavior. Specifically, letting {X, >t=0} be the 


stochastic process, it's a Markov process if, 


Pa aa, x Sole nee rm ey. 7 
n n-l n-~Z iL 
Se || ee 
n n-1l 
<t.< ene. 
where Os t < th s < ts 


A MARKOV CHAIN (MC) is a discrete time Markov Process, 
(n=1,2,3,...), with a finite number of states. The common assumption 
that the transition probabilities are stationary, i.e., dependent only 
on the states i and j and not on the time n, is assumed in this paper. 
The law of motion for the process may then be described by the one 
step transition probabilities of going from state i to state j, 

Pi, = Pr K 4 =o x = i) 
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A TRANSITION MATRIX is a finite array of real numbers which 
specify the one step transition probabilities of going from state i to 
state j, 

Pi Pe X41 = ee 9 


hence they satisfy the conditions that for every i and j, 


rr 
ij = 
S 
and \ p= 1 
me 


The classification of the states of a process become important 
when dealing with the asymptotic properties and also in the physical 
interpretation of the states. For Markov processes, the states are 
Classified according to their limiting behavior. Given that a process 
is initially in state j, if the ultimate return to state j within a finite 
period of time is a certain event, state j is called POSITIVE RECURRENT. 
If a process starts in state j and subsequent visits to state j can only 
occur at timest, 2t, 3t..., state j is called PERIODIC with period t. 
A state which is not periodic is called APERIODIC., A state is ERGODIC 
if it's positive recurrent and aperiodic. 

In this paper all the states are ergodic and the properties 


developed will apply, although they are not necessarily restricted to, 


processes all of whose states are ergodic. 


An illustrative definition of a continuous time MP with a finite 


state space is that it's a stochastic process which moves from one 
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state to another among a finite number of states with successive states 
visited forming a Markov chain. The process stays in any state a 
random length of time, the distribution function of which is exponential 
and dependent on the current state as well as the next state to be visited. 
Define a as the mean value of the conditional exponential dis- 
tribution for the length of time spent in state i given that the next 
transition will be into state j, and m, as the unconditional mean length 


of time spend in state i. The relationship between ite and m, is 


— m 
ou d >, ij 


The unconditional mean length of time spent in state i will be 
a positive, finite value for every state considered in this paper, i.e., 


0< m, <M 


B. LIMITING PROPERTIES 
In order to obtain specific values for many of the expressions 
developed, it is necessary to use their limiting approximation as time 
approaches infinity. This limiting behavior is presented in this section. 
Given that a transition into state j occurred at time t = 0, the 
expected time until the process next enters into state j is called the 
MEAN RECURRENCE TIME of state j and is denoted by 8 . The value 
of the mean recurrence time of state j is the summation, over all 


possible paths (8) which begin in state j and terminate at state j with 
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no intervening visits to state j, of the probability of the path being 


taken multiplied by the expected time to traverse the path. 


8. = » (OMe) (ems) 
j (h,k) 6 @ hk a hk 


Over a long period of time, (t > 0) if all states are ergodic 
and Pi < 00 for every j, the probability of finding a Markov Process 
in any state j equals the ratio of the unconditional mean time spent 
in state j to the mean recurrence time of state j. 

Specifically: 

limit Pr ==, / 8 
t ) ) 
t > @ 
The above theorem with trivial alterations is proven by Smith [Ref. 6]. 

After a period of time t > > B, has elapsed, the expected number 
of transitions into state j is approximately the time t divided by the 
mean recurrence time for state j. Letting ue (t) be the number of tran- 


sitions into state j during [0,t], 





The expected number of those transitions into j which came from state 
iis,in steady state, the number of transitions into state i times the 


probability of a transition from i into j. 





Cc. SEMI MARKOV PROCESSES 

A generalization of the definition of a Markov process with regard 
to the distribution function of the time spent in each state results ina 
Semi-Markov Process (SMP). 

A descriptive definition of a finite arate SMP is that itis a 
stochastic process which moves from one state to another among a 
finite number of states with successive states visited forming a Markov 
Chain. The process stays in any state a random length of time the 
distribution function of which may depend on the current state as well 
as the next state to be visited. 

Notice that the only difference between a MP and a SMP is 
whether or not the conditional distribution of the length of time spent 
in each state is exponential. 

The development of the SMP which follows is based on that given 
by Pyke [Ref. 7]. 

Define Qi (t) as the probability that, given aie system starts 
in state i at time zero, the first transition is into state j and that it 
occurs on or before time t. 

Then Q = (Q,) , iS an s xX S matrix valued function defined on 
(- 00, + 00), whose elements QF are non-decreasing functions 
satisfying 


(1) QF (t) = 0 t< 0 
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and (2) yy Qi; (+ 00) 


It now becomes natural to define 
= o “r 00) 
P,, Qi ( 


and to assume that 


and 


so that the s x s matrix, P= i, ) , becomes the transition matrix for the 


Markov Chain describing the sequence of states visited. 


The probability of leaving state i before any time t, independent 


of which state you go into next, is the unconditional distribution 


function of the time spent in state i and is 


S 
Q; (t) = d, Qj (t) 


The distribution of time in state i, given that the next transition 
will be into state j, is simply 


Q.. ({t) oe 
Q.,. t= i # j 
1j) 
1j 
The following notation is introduced to define the moments of 
the distributions thus far discussed. The conditional mean and con- 


ditional variance of the lengtn of time spent in state i given that the 
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subsequent transition will be into state j, are respectively 


00 
Phe ] eens 
0 
2 00 
o = J @-my? ag 
ij : ij if j 
0 


and the mean and variance of the length of time spent in state i re- 


gardless of the subsequent transition, are 


00 S 

a= f tao, > 3 Py 
0 j=l 

2 00 


Q 
il 


Z 
Jf tem)? ao, 
s 


Notice that the expressions developed for the asymptotic con- 
dition as t ~* 00 and for the mean recurrence time are distribution free. 
They apply equally to a MP and SMP as long as the distribution function 


for the length of stay in each state has a finite mean. 


D. THE ALTERNATING PROCESS 


If the number of states is restricted to two and the requirements 


maintained that 


p,. > 0 if j 
and 


Ze 





Piy 
a SMP becomes an alternating renewal process since 


P, > 0 implies a i,i=1, 2 and i #¥j 
J 


In an alternating renewal! process the equation for mean recurrence 
time reduces to the sum of the mean length of time spent in each state, 
because the Pi equal either zero or one depending on whether or not 
i equals j, and is the same for both states, i.e., 


= = 
Sm yyy Uae 


The distribution function of the recurrence time is the convolution 
of the distribution functions which specify the length of time spent in 
each state. Further, the fact that 


* = * 
G,*G, ¥) =G, *G, ty) 


implies Jee in a two state alternating renewal process the distribution 
of recurrence time for each state is the same and may be called the 
recurrence distribution of the process. 

Let Y, and Y. be random variables having distribution functions 


] 2 


G, and Gy which describe the length of time spent in states 1 and 2 


respectively. The distribution of the recurrence time (G), is the 


distribution of the random variable Y where Y = Yy a Yo ; 
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then 


As a specific example, let 


_ ax x x 
G, &) =l-e and G. (x) =l-e 


y y; 
~X xX = ( ha 728) i a 
ay (a=. ) 
0 = 0 
= aX Y - ay ,( a-A )y 
=l-e - je (e -1) 
(cue ee) 
= (0, Sa r (e a e %%) 
(a- A) 
Qo Je IDE 


In an alternating renewal process, the probability that the process 


is in state 1 at time t is the sum of the probability that state l was | 


occupied initially and the length of time spent in state 1 is greater 


than t, and the probability that the system, independent of where it 


started, left state 2 ata time t', for some t' < t, and the stay in state 


l is greater thant -t’. In the limit, the value of this probability is 
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limit Pr X, =e 

t, 200 
A formal proof using the strong law of large numbers is presented by 
Cox [Ref. 8]. | 

Another interpretation of the above equation is that after a very 
large number of transitions, the system will have spent a proportion of 


Q g e : 
time m, | 1 in state ] 


Since Pig = = 1, the expected number of transitions into 


ol 
state 2 from state last ~ 00 equals the expected number of transitions 


into state l. 


Nig =n, =t/8, 


le STATISTICAL CALCULATIONS 

When calculations are being made from sample data, the proba- 
bility of a transition from state i into state j is estimated as the number 
of observed transition from state i into state j divided by the total 


number of transitions from state i. Specifically 


: \ 

where a, is the number of observed transitions from state i into state j. 
Similarly, the mean length of time spent in any state i, con- 

ditional and unconditional, is simply the arithmetic mean length of 


time spent in state i from the observed data. -These values are called 
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the sample means. 


= ] 
TS n.. 
1) 
and 
eo 
l n, 
l 


a 





IV. CURVE FITTING 


The method of moments is employed for parameter estimation 
while attempting to fit a continuous distribution function to the data. 
The single parameter exponential distribution is assumed and the sample 
mean equated to the assumed population mean and a solution obtained 


for the unknown parameter. 


A. THE EXPONENTIAL DISTRIBUTION 


The exponential distribution function is 
aio | t 
t)=l-e ij 
Q, ; 0 j 
has a mean value 


E(t) = 1 = m 


Qa... 
1j 


1) 


and a variance 


A convenient attribute of the exponential distribution is its 
"Memoryless" property. This property specifies that if the length 
of time spent in any State k is distributed exponentially, the remaining 
time in state k, given it has already been in state k for some time the 
is a random variable with an exponential distribution independent of ty : 


A proof follows: 
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Q(t)=l-e 
t 
q(t)= ae = 
00 
Pr (t > 2Z) = fae 4 ea ; 
Z 
Pr (t>Z+t,) 
ieee ieee) fe 
Prats ts) 
= ] 
-a (Z +t.) -a Z 
=e a 
aera 
Pr (t>Z+t, t2t)) = Pr (tz 2) OcE.wD. 


When the conditional sample mean is equated to the mean of 


the exponential distribution in accordance with the hypothesis, (Ho), 


that the conditiona! time in state is distributed exponentially, the results 


are: 


[Ref . 


THE KOLMOGOROV-SMIRNOV GOODNESS OF FIT TEST 
The KOLMOGOROV-SMIRNOV TEST for goodness of fit, Massey 


9], is used to test the hypothesis that the data comes from an 


exponential distribution. The test is based on a comparison of the 


magnitude of the maximum difference between the set of sample values 


and the theoretical cumulative distribution as compared with tabulated, 
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Critical values for the appropriate sample size at a specific level of 


significance. Specifically, if the assumed cumulative distribution is 


and the observed cumulative step-function of the sample is 


R,.(t) = r 
1) 
n,, 
1) 
where r is the number of observations less than or equal to t; then the 


sampling distribution of 
By = maximum | Qj - R (t) 

is known and is independent of Qi; Goi 

The tables associated with the Kolmogorov-Smirnov Test give 
critical values of the distribution of E for various sample sizes. For 
example, at a 0.20 level of significance, the critical value of E for 
or = 10 is 0.322; this means that in 20 percent of the random samples 
of size 10, the maximum absolute deviation between the sample cumu- 
lative distribution and the population cumulative distribution will be 
at least 0.322. If the calculated value of E is less than this critical 
value there is no reason to reject the hypothesis that the sample came 
from the assumed distribution. 

Reference 10 also compares this test with the chi-square test 


for goodness of fit and notes that it is superior in many cases. 
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V. THE TWO STATE MODEL 


The two state model considers the states of WAR and NO-WAR, 
and will be developed separately for each of the two possible modes of 
data interpretation. Initially a two state model which considers each 
military conflict, regardless of intensity or economic implications, as 
a state of WAR will be formulated because this is the typical classi- 
fication in studies involving cost-effectiveness. (Weapons systems 
employed vs weapon system not employed.) Subsequently, the inter- 
pretation of data such that all military conflicts which would not be 


classified as WAR in the three state model will be classified as NO-WAR. 


A. THE TRANSITION MATRIX 
The transition matrix for both of the two state cases is simply 


and uninterestingly 


W NW 
WwW 0 i 
NW 1 0 


B. TWO STATE MODEL (CASE I) 

In case one, all the periods of conflict, regardless of intensity, 
are considered periods of war. 

The periods of time during which a state of NO-WAR existed, 


as taken from Figure 1 are: 


3) 





State of NW 


Apr 1783 - Nov 1798 
Sep 1800 - Jul 1801 
Aug 1805 - Nov 1811 
Dec 1814 - Mar 1815 
fom 1sl5 - Nov 1817 
May 1818 - Apr 1832 
Aug 1832 - Jun 1835 
Dec 1843 - Mar 1846 
Feb 1848 - Jan 1850 
Oct 1879 - May 1885 
Sep 1886 - Dec 1890 
Jan 1891 - Apr 1898 
Dec 1898 - Feb 1899 


Length (mo.) 


187 


State of NW 


Fula oct 1906 
Dec 1909 - Jan 1912 
Jan 1913 - Apr 1914 
Nov 1914 - Jul 1915 
as 1915 - Mar 1916 
Apr 1920 - Jan 1927 
Nov 1928 -— Jan 1931 
Jan 1933 - Dec 1941 
Aug 1945 - Jun 1948 
Sep 1949 - Jun 1950 
Sue oo col koa 
Oct 1958 - Nov 1960 
Dec 1960 - Dec 1961 


The sample mean for the state of NO-WAR, 


NW | 


1184 


26 


ength (mo.) 


iS 


= 45.5 months = 3.8 years 


Similar calculations for the state of WAR yield the following 


result: 


ty T 


ay 


1153 


= 42.7 months = 3.6 years 


The value of 42.70 months for the mean length of time spent in 


a state of WAR is slightly conservative because it assumes a transition 


occurred at the data end points, i.e., that a state of NO-WAR exists 


in March 1775 and February 1970. 
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The data on the length of stay in each state is assumed to have 


come from exponential distributions having parameters OW = 0.0234 
and OW = 0.0220 and mean values Mya = 42.7 months and Maw = 


45.5 months. 

The resulting distributions, Qyy and Qnw lt) are plotted against 
their respective cumulative step functions from the observed date in 
Appendix A. In both cases the Kolmogorov-Smirnov test for goodness 
of fit gives no indication that the exponential assumption, (Ho), is 
invalid, therefore Ho is accepted. 

Functionally these distributions answer the question, "Given that 
the United States is in a state of war, what is the probability that the 
war ends within two years, five years, ten years?" The answer, for 
this model is: 


7 ~.0234t 
Qy,, (t) =l-e 


ie WN Ss A tS Qw (Fay = 439% 
Pr (t <5 yrs) =Q_. (60) = 75% 
= W 
Pr (t < 10 yrs) = Qw (120) = 94% 
The mean recurrence time for the system is 
Ry = Bw = My i Mw = 88.2 months = 7.4 yeers 
The limiting probability that the system is in each of the two 


states, or the long run proportion of time spent in each state is 


limit PrX =NW) = "NW = 45.5 = 52% 
: 8 88.2 
t + @ NW : 





m 
limit Prk = WAR) = W. = 42.7 == 48% 


The distribution function of the recurrence time for the system, 


= * 
G(t) Qw Qnw"?) 
where Qy ®) =]- oa “i 
eee O22 Oe 
and Quw =l-e 
i Git) = 1 ~ 0770220 t 4g) (9710220 t 7 +0234 t, 


Using this distribution function answers can be obtained to 
questions such as, "Given that the U. S. is in a state of war at some 
time One what is the probability that the U. S. will fight in a second 


war within ten years of time B 2" 


Prix, = war)” for some t, Os < t< LORer eee — war") 


= G(120) = 77% 
The average number of transitions into a state of war that a 
system with a life cycle of thirty years should expect to experience is 


T ‘] = 30 yrs = 4 transitions 
7.4 yrs 


from the fact that 


limit 


© a210¢ j 
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C. TWO STATE MODEL (CASE II) 

In case II the periods of half-war and relative peace are grouped 
together as the state of NO-WAR. Only the major military conflicts 
classified as wars in the three state model are called states of WAR in 
this model. 

The periods of time during which a state of WAR apdiguad. from 


Figure l, are: 


STATE OF WAR LENGTH (months) 
Apr 1775 - Apr 1783 96 
Jun 1812 - Dec 1814 30 
Mar 1846 - Feb 1848 a 
Apr 1861 - May 1865 49 
Apr 1898 - Dec 1898 8 
Feb 1899 - Jul 1902 4] 
Apr 1917 - Nov 1918 19 
Dec 1941 - Aug 1945 44 
fem 1950 - jul 1953 37 
Aug 1964 - Jan 1970 65 


Notice that again in this model a change of state is assumed to exist 
at the data end points. 


The sample mean from the above data, for the state of WAR is 


OW 
ny wee (k) a 
2 = 1] ty = 412 = 41.2 months = 3.4 years 
a 10 
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Calculations for the state of NO-WAR yield 
t... = _1925 = 213.9 months = 17.8 years 
3 

It is interesting to note that the difference in the average time 
spent in a state of WAR between Case I and Case II is less than — 
months, (42.7 mo. vs. 41.2 mo.) yet the average time spent in a state 
of NO-WAR varies by nearly a factor of five, (45.5 mo. vs. 213.9 mo.). 

The test of the hypothesis that the data is from exponential 
distributions with parameters Oya = 0.0243 and OW = 0.0047 is 
contained in Appendix B. Asa result of the test, the exponential 
hypothesis is accepted. 

Given that the U. S. is ina state of NO-WAR at some time toe 
the probability that the country will escalate into a state of WAR during 
the next two, five or ten years is, 


-.0047 t 


Qyw = -e 


Pr(X, = WAR, for some t, La t < 2 yrs | X. = NW) = Qnw 24) = 11% 


Prix. = WAR, for somet, aces VS | X, = NW) =Q (60) = 24% 
O 


Pr(X, = WAR, for somet, th < t 


I 
Z 
Ss 

I 


(120) = 43% 


lA 


Q 


l 
0 yrs | aa coi 


The mean recurrence time for the system is 


= = a = ‘ = 21. 
Ba Baw May Mw 255.1 mo = 21.3 years 
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The limiting probability that the system is in each of the two 


states, or the long run proportion of time spent in each state, is 


limit Pr&® = NW) = NW = 213.9 mo. = 84% 
: B 255.1 mo 

t + 00 NW 

limit Pr(X, = WAR) = awe = ade? mo. = 16% 

t + 00 8 ee 


The distribution of recurrence time for the system, 


Gi One Oo. 
where Q yy &) =n on 0243 x 
and Qn &!) =e —7 0047 Xx 
is Git) = 1 = 2779047 t _(q.24) (970047 t _97 +0243 ty 


Given that a state of peace exists at time ty! the probability 
that the U. S. will have engaged in one war and returned to a state 


of NO-WAR witkin ten years of = is 


os, = WAR, <m = NW, for some t and ty. om < ty 2 


x = NW) = G(120) = 31% 
O 


The average number of escalations into states of WAR that a 


system with a thirty year life cycle should expect to exp-rience is 
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Ak 1 = 30 yrs = ] escalation 


from the fact that 


limit " (t) = ] = 19 


t + @ : 


IP 
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Vier lee TAREE OTArE MODEL 


The interpretation of data for the three state model is presented 


in Figure l. 


A. STATE TRANSITIONS 


The conditional sample mean time in state, 


t= 1 » t &) 


ili n.. ker TB 
1} 





the corresponding values of the exponential parameter, 


and the unconditional sample mean time in state 


S 
a 
1 


j=l 


p,, t, 

ij ifj 
will be calculated and the three state transition matrix developed. 

It must be noted that the convenient assumption that a transition 

occurs at the data end point of January 1970 is of no value in this 

model because knowledge of the next state is not a certain event. The 
result of this conditional dependence on the next state visited is that 
the unconditional mean time spent in the state of WAR will be conserva- 


tive since it was computed from 


oF 





myc ys he 


J 


and neither t nor t 


Ne 


ie 


ij i 


considers the length of the Vietnam 


conflict which has as a minimum length a value which would cause an 


increase in the computed average time spent in a state of WAR. 


NW - HW 
Nov 1798 187 
Jul 1801 10 
Nov 1811 is 
Mar 1815 3 
Nov 1817 29 
Apr 1832 167 
Jun 1835 34 
Jan 1850 128} 
May 1885 67 
Dec 1890 a 
Oct 1906 15 
Jan 1912 25 
Apr 1914 15 
mol 1915 8 
Mar 1916 6 
Jan 1927 81 
Jan 1931 26 
Jun 1948 34 
Jul 1958 60 
Nov 1960 25 
Dec 1961 el: 


S55 mo. 
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NW - W 
Mar 1846 27 
Apr 1898 87 
Feb 1899 2 
Dec 1941 106 
Jun 1950 9 
Zo laine 
Prrw-w = 9/26 = 0.19 
M rw-w = tuwlw = 46.2 mo. 
= 3.9 VES. 
'o4 = 
NW-Ww 0.0216 
Many = 45.5 mo. = 3.8 yrs. 





eee =n 25 - 0.81 


"NW-HW ‘NW| HW 


® yw-HW = 070220 
HW - NW 
Sep 1800 22 
Aug 1805 49 
Jun 1815 3 
May 1818 6 
Aug 1832 4 
Dec 1843 102 
Oct 1879 173 
Sep 1886 16 
Jan 1891 1 
Jul 1905 36 
Dec 1909 38 
Jan 1913 12 
Nov 1914 7 
Sep 1915 2 
Apr 1920 17 
Nov 1928 a3 
Jan 1933 24 
Sep 1949 15 
Ser 1958 3 
Dec 1960 wefan 
904 mo. 
eenw > 20/24 = 0-83 
“HW-NW  ‘NW|HW 
OOK Son 


= 45.4 mo. = 3.8 yrs. 


HW - W 
Jun 1812 7, 
Apr 1861 (hoe) 
Apr 1917 13 
Aug 1964 32, 
187 mo. 
Puw-w > 4/24 =0.17 
m = 46.8 mo 


Maw = 30.1 mo. =2.5 yrs. 


=e? MOr = 2.3 YTS; 





W - NW W - HW 
Apr 1783 96 May 1865 49 
Dec 1814 30 Jul 1902 4] 
Feb 1848 eS Nov 1918 19 
Dec 1898 8 109 mo. 
Aug 1945 44 
fat 1953 37 
23 Oa 
Dy _-NW 6/9 = .67 PweHw = 3/9 = .33 
™w-nw ‘w| NW 3 <7 Ino Mew > tw Hw 36.3 mo 
= 3.3 yrs = 3.0 yrs 
a W-NW > 0.0252 o WeHW 0.0275 


NW 
NW 0 
HW Fie: 
W 707 


my, = 3e.6 ela Sh vege 


HW W 

518). abs, 
0 v7 

58 0 


The distribution functions Q; and Ri (t) are plotted for each i 


and j, and the value of E_ is determined in Appendix C. In no case 


is any cause for rejection of the hypothesis found, therefore it is 


accepted that the conditional time in state is exponentia!ly distributed 


making the Semi-Markov process actually a Markov process. 
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The matrix of conditional transition distributions, Q = (Q.,), is 


ij 
NW HW WwW 

— 7 rl (1-e7 022 0t 19 (-e7 1 0216t) 

enw || 639 Gemma 0 iy Gg te 

“5 +87 (1-e7* 0252t) 33 (1-e7 0275t) 0 | 


and the unconditional distribution of time spent in each state, 


Q, = ) Qi (t) 


is: 


Quylt) =1- (Be VF - (19) e797 8P% 
Quaytt) = 1 = (830 PPE = Care 80 
Q wit) = 1 - (67) PF — (.33)0° 1 9779% 


The following questions are typical of those which can be 
answered using these distribution enone A 

Given that a state of HALF-WAR currently exists, what is the 
probability that an escalation into a state of WAR will occur within 
the next five years and prior to a de-escalation into a state of peace? 
Statistically the question asks for the product of the probability that 
the next transition is from HW into WAR and the probability that the 
transition occurs within the next five years. 

The answer is obtained by simply evaluating the appropriate 
element of the Q matrix, at a time equal to five years. In this case 


=o 4 ; 
ven 5) = 12% at t= 5 years. 
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Given a state of WAR exists, what is the probability that a de- 
escalation will occur within the next five years? 


= Zot OZ ot 


Qy,) =1- (.67)e - (.33)e 


Q\y (69) = 71908 


Bi. MEAN RECURRENCE TIMES 

The equation for mean recurrence time, 

ieee ) CT Ppp) | >) 

(h,k) e€ 8 

may be described in a form more responsive to computational manipu- 
lations by attempting a "brute force" approach when the Bie hae of 
states is sufficiently small to permit this tactic. 

For example, in a basic three state model, 
by beginning in state 1 and considering initially 
only those paths whose first transition is into state 2, it is possible 
to write an expression for the average length of time it would take to 
traverse each possible path, from state 1 back into state 1, times the 
probability of such a path being taken. For two, three and four tran- 
sitions, the expressions are respectively: 

Pye Poy (Mp FM) 


Wiha = 2 1 ee) 


2s a ak Mn Dy Sc 


Pio 53 P32) Poy (my. + mQ3 + M3, + mq) 
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It will soon be evident that the paths being described which 
contain an even number of transition form the series 


00 
ory 78 
y Py Paz (Paz P32) |™4 ip, + k(m,, + m9) 


k=0 
and those containing an odd number of transitions form the series 


00 
k 
* # + 
y Piz P23 P31 32 P23) [M2 + ™Mg3 + M3, tk (mg, m,4)| 
k=0 


Notice that this approach applies because Pp. =(Q. 


Because of symmetry in the mode! the paths from state 1 which go 
initially into state 3 form identical series with the subscripts 2 and 3 
reverse. Therefore, all possible first passage paths from state 1 may 
be explicitly counted. 

As stated previously, the product of the average length of time 
spent traversing each of these paths and the probability that such a 
path will be selected, wznen summed over all possible paths becomes 
the mean recurrence time (8), which in this instance is 

00 
: ( )* +m, +k (m,, + m,,) 

8) y PTD Pay ae) Hep [™12 aaa mo. a2 

k=0 

00 
+ - (p ie a =. 

Pieeag pam fae Pog’ || 12° 23 ° 3] 
k=0 
+ + 
k(m,, mo) | 
(cont'd) 
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00 


k 
+ 3 + + + 
P13 P31 3 Po3) [ ™) 3 mz, + k(m,, m, 3)| 


k=0 
00 
+ \ (p ‘a aE + 

ion ear 2 20" a2 [my aD rah 

k=0 | 
+ + 
kim), m,)] 
the term, P,. Pao) , Will always be less than one, hence upon expanding 


the above equation, each term may be recognized as either a geometric 


series or a simple variation thereof, both of which have limits. 


Specifically, 
00 
». k 
ap = a p< lil 
K=0 (1 = p) 
00 
akp = ap p<] 
k=0 (i - aie 


The equation for mean recurrence time becomes 


= ( ) + + + + 
_———— [Pia Par (yg * My) * Py Pog Pg (pq + MQg +My) 
Oe) ae 


+ Pig Pay (m4 + M31) t+ Py3 Paz Poy (M3. + M3. t m 1)] 


Py. P 
+. + + + + 
2332 [32724] Piz Por *Piz Pag P31 *Pig °317Pig?32 Pal 


(1-p if 


23 °32 
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When this equation is used for the calculation of mean recurrence 
times the following results are obtained: 


8B. = 252.5 months = 21 years 


W 

= 94,7 hs = 7. 
Bw 9 months 9 years 
Bw = 87.4 months = 7.3 years 


The interpretation placed on these values is that over a great many 
years the average length of time the United States spends between states 
of WAR is twenty-one years, between states of NO-WAR approximately 
meven years, CLC. 

A comparison can be made between the mean recurrence times 
suggested by the model and the arithmetic average recurrence times 
from the data, however, it should be noted that very close agreement 
should only be expected between the mean recurrence times for WAR. 

The end ee of the data are both states of WAR ~‘1erefore the arithmetic 
average time between states of WAR involves no assumptions and should 
agree with the value suggested by the model. 

The longest interval between states of HALF-WAR is the con- 
servative 283 months which occurs pois the first HALF -WAR. Current 
events indicate that the length of the Vietnam conflict is also a con- 
servative value and when applied as a mean recurrence time for HALF- 
WAR it becomes even more conservative because it may be followed by 
a period of NO-WAR before a recurrence of HALF-WAR. A similar 
argument applies to the state of NO-WAR; therefore it is expected that 
the arithmetic average recurrence time for HW and NW will be less than 


the value suggested by the model. 
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The values of mean recurrence time compare as follows: 


calculated arithmetic 
value from the average value from 
State model the data 
WAR 255 MO. Zaemo-. 
HALF-WAR 95 mo. 64 mo. 
NO-WAR 87 mo. 43 mo. 


The large disparity between the calculated and sample value for 
the state of NO-WAR is a result of the fact that of the ten sample points 
where the length of time in a state was six months or less, seven 
appear as sample values of recurrence time for the state of NO-WAR. 
Perhaps the tactic of "display of strength" such as sending warships 
to protect Guatemala and Nicaragua in late 1960 or the Cuban Missile 
Crisis in 1962 should not be considered as — of HALF -WAR because 
of their brevity and the fact that weapons per se were not expended. 
This would certainly decrease the variance between the two values in 
question. Yet the possibility that the appearance of the majority of 
the small sample values as intervals between states of NO-WAR may be 
Classified statistically as an unusual sample cannot be dismissed. The 
sensitivity of the model to changes in data base is not investigated 
in the paper, however it is assumed, as an alternative to declaring the 
model a misfit, that a less than optimal method of historical data clas- 
sification plus the occurrence ofa statistical rare event account for 


the difference between the two values. 
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Cx PROBABILITY OF STATE OCCUPATION 


The limiting probability of finding the system in each of the three 


states, 
m 
li mit Prix, = j) = j 
t + 00 g. 
J 
is: 
limit PrX, = WAR) = 38.6 = 15% 
t > @ Zoe 
limit Prix, = HW) = SO = 32% 
t. 00 94.7 
limit Prix, =NW) = 45.5 = 52% 
t + 0 87.4 


The probabilities do not sum to one because the mean time in 
state was calculated as the sum of the conditional mean times and 
therefore precluded the use of all the data. The difference of 1% is 


considered insignificant. 
D. NUMBER OF ESCALATIONS INTO WAR STATES 
Employing the limiting probability that 


limit n (t) 


t * 00 t B 


and the fact that 


the following type of questions can be answered. 
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Given a weapon system with a thirty year life cycle, the average 


number of war escalations, of each type, it should expect to witness is 


ONW-HW T= Ow PNW-HW T= =. (.81) (30) = 3 escalations 
DanWw-W T= Ow Dee T= = (.19) (30) = 1 escalation 
Ninw-w T= New Puw-w T= 2 (.17) (30) = 1 escalation 


Ee LIFE CYCLE COST EQUATION 


Using the limiting values obtained for the three state model, the 
long run, average life cycle cost equation of chapter I can be written 
more explicitly for a weapon system with a life cycle of T years, as: 

Life Cycle Cost = (R&D cost) + (Peacetime Investment cost) 


sree IEE t t en 
( T) (Investmen cost/transition) 7) 4. 


+ (.026 if t t iti 
( T) (Investmen cost/transition) 


ay = 
(.021 T) (Investment cost/transition) 


+ (.52 P 
(.52 T) (Annual Ops Cost, pace 


Te ; 
(.32 T) (Annual Ops COST ee ccc 


Foe) Annual Ops Cost vp) 


In this form it is conceivable that such an =quation could be 


of value to a decision maker. 
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VII. COMPARISON OF RESULT FROM EACH MODEL 


The following is a tabulation of the important results from the 


three cases investigated. Ajl times are in months, 


2 ~- State 


Case I (HW=W) 


Case II (HW=NW) 


Marry 49°9 213.9 
aw 
1eeZ 
m,, 42-7 4 
B a2 25 5cc8 
nw 88 5 
Pw 
By, 88.2 hays ee | 
limit PrX=NW) .52 84 
t > 0 
limit Pr KX =HW) 
t +O 
-48 ~16 


limit Pr (X =W) 
t > 0 


3 - State 


45. 


S110) 


Soe 


ove 


94. 


TASTE 


Gey 


232 


hs 


The results provided by Case I of the two state model compare 


more favorably with the results of the three state model, (except for the 


mean recurrence time of war) than those of Case II, however it should 


not be assumed from this that Case I is to be preferred to Case II. 


If conditions necessitated the use of a two state model the nature 


of the problem and type of solution desired would indicate the more 


preferable case. 


ul 





VIII. CONCLUSION 


In the author's opinion, the area most susceptible to error is that 
of data identification and classification. Further it is felt that this 
error will be minimized if the historical fae utilized is restricted to 
conflicts of the specific type or style of combat being considered in 
the problem at hand. For example, ina cost-effectiveness study for 
- the selection of the best among several amphibious landing vehicles 
the historical data should be restricted to conflicts which included 
amphibious assaults. } 

The reader is warned against using the model to predict a specific 
event or to answer questions such as, "Giventhe U. S. is ina state 
of WAR in January 1970, what is the probability that the war will end 
by January 1973?" The values obtained from the model are the average 
values to be expected over a long period of time and their use in pre- 
dicting individual occurrences should be avoided. 

The simplicity of the model, as indicated by the fact that all 
the calculations can be done by hand, should encourage its use as a 


tool in cost-effectiveness methodology and encourage an extension of 


the technique to other applications. 
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